Autonomous Solution Methods for Large Markov Chains

One of the roadblocks to greater application of Markov chains is that non-numerically sophisticated users possess the detailed domain knowledge needed to construct a large Markov chain but may have a difficult time deciding which numerical solution method might be best suited to their applications. A realistic Markov chain model can easily contain hundreds of thousands of states, yet users may severely restrict their models to keep them small enough to fit within the constraints of certain software packages or solution methods. By making judgments about the Markov chain, an experienced researcher or practitioner can sometimes propose a solution technique in a short amount of time. This research examines methods to obtain a proposed solution technique without the services of an expert and with little or no intervention from the novice user. We take advantage of information readily available in the Markov chain to aid in the selection and execution of a solution method. This can be done without the user being an expert in the various solution techniques and their respective areas of applicability. (Markov Chains; Expert System; Linear Systems; Solution Methods)